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Abstract 

Recent results on source-channel coding for secure transmission show that separation holds in several cases under 
some less-noisy conditions. However, it has also been proved through a simple counterexample that pure analog 
schemes can be optimal and hence outperform digital ones. According to these observations and assuming matched- 
bandwidth, we present a novel hybrid digital/analog scheme that aims to gather the advantages of both digital and 
analog ones. In the quadratic Gaussian setup when side information is only present at the eavesdropper, this strategy 
is proved to be optimal. Furthermore, it outperforms both digital and analog schemes and cannot be achieved via 
time-sharing. An application example to binary symmetric sources with side information is also investigated. 

I. Introduction 

The setup of source-channel coding for secure transmission consists of three nodes that measure an analog source 
as a function of time. One of them (referred to as Alice) wishes to transmit a compressed version of its observation 
to a second node (referred to as Bob) through a noisy (or wireless) channel. In addition. Bob can use his own 
observation as side information to decode the received message and refine his estimate of Alice's source. The third 
node (referred to as Eve) is an eavesdropper i.e., a node that can listen to the messages sent by Alice through 
another noisy channel, as shown in Fig. [T] Considering Eve as an untrusted node, Alice wishes to leak the smallest 
amount of information about her source. 

Among some major information-theoretic issues, the above scenario involves the notion of secrecy (and its 
application to source and channel coding), source coding with side information, as well as joint source/channel 
coding for transmission of sources over noisy channels. The information-theoretic notion of secrecy was introduced 
by Shannon |[T| and used for secure communication over noisy channels by Wyner t2J, who introduced the wiretap 
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Network of Excellence in Wireless COMmunications NEWCOM+-I-. 
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Figure 1: Secure transmission with side information. 



channel, which was further extended by Csiszar and Korner JS). On the other hand, source coding with side 
information has been introduced by Slepian and Wolf iU, and Wyner and Ziv l|5]. Recent results ||6l, Q consider 
such settings with an additional eavesdropper that must be kept as ignorant as possible of the transmitted source. Most 
of the existent work separately consider channel or source coding for secure transmission or compression. However, 
unlike simple point-to-point communication problems, there is no general result of separation for multiterminal 
settings under security constraints. Recent work ISl, ||9l about source-channel coding for secure transmission shows 
that separation holds in several cases under some less-noisy conditions. Whereas a simple counterexample in ||9l 
showed that a pure analog scheme can improve digital schemes while being optimal. This observation motivates us 
to investigate hybrid digital/analog schemes for such setting, which by taking advantage of both analog and digital 
strategies may yield better performance. Indeed, such schemes have already been proved useful for point-to-point 
problems e.g., to handle SNR mismatch (while they can perform as good as digital or analog ones at the true 
SNR) lUni, mil, as wen as for some multiterminal settings lfT2l. lfT3l. 

In this paper, we consider the setup of joint source-channel coding for secure transmission of a source over a noisy 
channel with an eavesdropper, and in the presence of side information at the receiving terminals. We restrict our 
attention to the matched-bandwidth case i.e., one channel use is allowed per source symbol, as depicted in Fig. [T] 
Our main goal is to understand how Alice can take simultaneous advantage of both statistical differences among side 
informations and channels. Section |ll] recalls some prior results that yield an inner bound (digital scheme), and a 
general outer bound on the distortion-equivocation region. A novel hybrid digital/analog scheme and its single-letter 
inner bound is derived in Section |III] Transmission of a Gaussian source over a Gaussian wiretap channel with side 
information (resp. binary source over a type-II wiretap channel) is studied in Section |IV] (resp. Section IVTl. 

Notations 

For any sequence {xi)i^-^*, notation cc" stands for the collection {xi,X2, • . • ,Xn). Entropy is denoted by H{-), 
and mutual information by /(•; •). Let X, Y and Z be three random variables on some alphabets with probability 
distribution p. If p{x\y, z) — p{x\y) for each x, y, z, then they form a Markov chain, which is denoted by X-o-Y -e-Z. 
The set of nonnegative real numbers is denoted by R+. For each a; e K, notation stands for max(0; x). Notation 
stands for the binary entropy function. The binary exclusive-or operator is denoted by 0. 
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II. Problem Definition and Prior Results 



A. Problem Definition 

Let A, B, £, X, y, and Z be six finite sets. Alice, Bob, and Eve observe the sequences of random variables 
(Ai)igN*, (Si)ieN', and respectively, which take values on A, B, and £, resp. For each i E N*, the 

random variables Ai, Bi, and Ei are distributed according to the joint distribution p{abe) on Ax B x £. Moreover, 
they are independent across time i. Alice can also communicate with Bob and Eve through a discrete memoryless 
channel p{yz\x) with input X on X, and outputs Y, Z on y, Z, respectively. Let d : A x A ^ [0 ; dmax] be a 
finite distortion measure i.e., < dmax < oo. Denote by d the component- wise mean distortion on A"" x A"' i.e., 
for each a", 6" £ A"", d{a"-, 6") = i X^Li d{ai,bi). 

Definition 1 (Code and achievability): An n-code for source-channel coding in this setup is defined by 

> A (stochastic) encoding function at Alice F : A" — > A"", defined by some transition probability Px"|A"('|')' 

> A decoding function at Bob g : x 3^" — > A". 

A tuple {D, A) G is achievable if, for any e > 0, there exists an n-code {F,g) s.t.: 



with channel input X" as the output of the encoder The set of all achievable tuples is denoted by TZ* and 

is referred to as the distortion-equivocation region. 

B. Prior Results 

Recent results ||9] provide inner and outer bounds on region TZ* which do not match in general. In the matched- 
bandwidth case, the inner bound TZa^ is defined by the next theorem. 

Theorem 1 (Digital Scheme 1^): The set of all tuples [D, A) e R\ such that there exist RVs U, V, Q, T, X 
on finite sets U, V, Q, T, X respectively, with joint distribution p{uvqtabexyz) — p{u\v)p{v\a)p{abe) p{q\t)p{tx) 
p{yz\x), and a function A : V x B ^ A, verifying the following inequalities, is achievable: 



The achievability of the above region follows by combining secure source coding Q with coding for broadcast 
channels with common message (3]. This results in two independent (but not stand-alone) source and channel 
components, yielding statistically independent source and channel variables i.e., "operational" separation holds. 
Such a scheme will be referred to as the digital scheme. In some special cases e.g., when Eve has less noisy 
channel, or Bob has less noisy side information, this inner bound becomes tight |9 1 and traditional separation holds. 
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Nevertheless, when Bob has "better" channel and "worse" side information than Eve, it was observed in jo) through 
a simple example that a naive analog scheme, consisting of directly plugging the source on the channel, outperforms 
the digital one of Theorem [T] Furthermore, it turns to be optimal since it can be shown that it achieves the next 
outer bound 7?.out. 

Theorem 2 (Outer Bound f^): For each achievable tuple (D, A), there exist random variables U, V, Q, T, 
X on finite sets U, V, Q, T, X, respectively, and a function A : V x B ^ A, such that p{uvqtabexyz) = 
p{uv\a)p{abe) p{q\t)p{tx)p{yz\x), and 

IiV;A\B)<I{T;Y) , 
D > E[d{A, A{V, B))] , 

A < H{A\UE) ~ [liV; A\B) ~ I{U; A\B) - (/(T; Y\Q) - I{T; Z\Q))]^ . 

III. Hybrid Coding for Secure Transmission 

Based on the observation made in |9| about the usefulness of analog schemes, we now propose a hybrid 
digital/analog scheme that yields the next inner bound 7?.hyb C TZ* . 

A. Main Result 

Theorem 3 (Hybrid Scheme): The set of all tuples (D, A) in such that there exist RVs U, V, X on finite sets 
U, V, X, with joint PD p{uvabexyz) — p{u\v)p{vx\a) p{abe) p{yz\x), x — x{v, a), and a function A : VxBxy ^ 
A, verifying the following inequalities, is achievable: 

I{U;A)<I{U;BY) , (1) 

I{V;A\U)<I{V;BY\U) , (2) 

D > E[d{A,A{V,B,Y))] , (3) 

A < H{A\UE) - I{V; A\U) - I{X; Z\UE) + min BY\U) ; I{V] AZ|f/)| . (4) 

Channels A^-^ B and X i-^ Y can be viewed together as a state-dependent channel with input X, state A and 
output {B,Y). In this perspective, Alice and Bob form a communication system with channel state information 
known at the transmitter (CSIT), as depicted in Fig. |2] Roughly speaking, the proposed strategy consists in sending 
independent digital random noise W using a Gelfand-Pinsker code fT?! for this equivalent state-dependent channel. 
Two auxiliary RVs ([/, V) constitute the descriptions of A. Digital random noise W here helps to secure description 
V against Eve. As in the classical wiretap channel fS), ifTSll , its rate satisfies some constraint that allows to 
characterize the equivocation rate at Eve. Finally, the auxiliary RV ?7 is a subpart of V that can be seen as a 
common message which is considered to be known at Eve, as shown by the term H{A\UE) in (01). 
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Figure 2: Alice and Bob as a communication system with state-dependent channel and CSIT. 



B. Sketch of Proof 

We provide a short sketch of proof of Theorem [3j Details will be given in an extended version of this paper Let 
Ri,R2,Rf £ M!i_ and assume that a local (independent and uniformly distributed) source with rate Rf is available 
at Alice. 

1) Codebook generation: Randomly pick 2"^^ sequences u"(ri) from T^{U). Then, for each u"(ri), randomly 
pick sequences w"(ri,r2,r/) from TJ'(y|u"(ri)). 

2) Encoding: Assume that source sequence A" and random noise rj are produced at Alice. Look for the first 
codeword u"(ri) such that (7i"(ri),yl") e T"([/, A). Then look for the first codeword w"(ri,r2,r/) such that 
(w"(ri, r2, rj), A") g T"(y, y4.|u"(ri)) and send X", defined by the component-wise relation 

= x{vi{ri,r2,rf),Ai) . 

By standard arguments, it can be proved that these two steps succeed with high probability if _Ri > I{U; A) and 
i?2 > I{V;A\U). 

3) Decoding: Assume that Bob observes B" and receives F" from Alice. Look for the unique codeword 
it"(ri) such that (u"(ri), _B", F") G T^{U, B,Y). Then look for the unique codeword v^{ri,r2,r f) such that 
(w"(ri,r2,r/),B",r") g T^{V, B,Y\u''{ri)). Compute the estimate g{B'\Y'^) e A^' using the component-wise 
relation 

g,;(B",F")^i(«,(ri,r2,r/),B„F,) . 

As noted in fTsl . the conventional random coding proof technique does not apply here, and the decoding error 
probability must be carefully handled. In the proposed joint coding scheme, a single codebook plays both roles 
of source and channel codebooks. For a given source sequence a", the indices (ri,r2) thus depend on the entire 
codebooks, and the averaging over the set of all possible codebooks cannot be performed in the usual way. Similarly 
to lfT3] . it is not difficult to show that these two decoding steps succeed with high probability if R\ < I{U ; BY) 
and R2+Rf < IiV;BY\U). 

4) Distortion at Bob: Provided the above constraints are verified. Bob can decode codeword r2, r/) with 
an arbitrarily small probability of error, and compute estimate g(y",i3") of A^. Using standard properties of 
typical sequences, it can be easily proved that the mean distortion of this estimate approaches E[d(A, A{V, B, Y))]. 
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5) Equivocation rate at Eve: The equivocation at Eve can be divided in "source" and "channel" terms. Each 
one is studied using standard properties of typical sequences, and the arguments of Q and lITSl Section 2.3. Step 3]. 
The next constraint which ensures that Eve decodes v^{ri,r2,r f) from (ri, A", Z") is required to characterize the 
equivocation 



6) End of Proof: Gathering the above inequalities and performing Fourier-Motzkin elimination prove Theorem[3] 
C. Special Cases 

1) Analog schemes: The proposed scheme can reduce to a pure analog one (as the simple one of 19] Section VI]). 
Hence 7?.hyb contains tuples that may not be in TZdig'. TZhyb 't- ^dig- 

2) Digital schemes: By defining the variables in Theorem [3] as pairs of independent source and channel compo- 
nents, we can obtain the structure of those in Theorem [T] but such variables do not verify aU inequalities and thus 

^dig ^ T^hyb- 

3) Wiretap channel: Choosing independent source and channel variables with appropriate rates, region 7?^hyb 
reduces to the achievable region for the wiretap channel |15 Eq. (2.6)]. 

IV. Secure Transmission of a Gaussian Source over a Gaussian Wiretap Channel 
A. System Model 

In this section, we consider the transmission of a Gaussian source over a Gaussian wiretap channel. More precisely, 
the source at Alice A is standard Gaussian, and observations at Bob and Eve are the outputs of independent additive 
white Gaussian noise (AWGN) channels with input A and respective noise powers Pb and Pg. Communication 
channels from Alice to Bob and Charlie are AWGN channels with respective noise powers Py and Pz. The average 
input power of this channel is limited to P. 

Euclidean distance on M is used to measure distortion at Bob ((i(a, 6) = (a — 6)^, for each a, & G M). Differential 
entropy h{-) measures uncertainty yielding equivocation rates A e K. We also introduce quantity De =^ 2^^/(27re), 
which provides a lower bound on the minimum mean-square error of any estimator of A at Eve. 

Definition 2 (Achievability): In this section, a tuple {D,De) G is said to be achievable if, for any e > 0, 
there exists an n-code {F,g) s.t.: 



R2 + Rf <I{V;AZ\U) . 



After some derivations, we can eventually prove that 



-H{A"\E"Z'') > H{A\UE) - I{X; Z\UE) + Rf - e . 



E[||A" <D + e , 

- h{A^\E^Z^) > I log (2^e De) - e 
n 2 




with channel input X" as the output of the encoder F{A'^). 
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Pb < Pe 


Pb > Pe 


Py <Pz 






Py>Pz 







Table I: Cases where 72.dig is tight and separation holds. 

Although Theorems [T}{3] are stated and proved for finite alphabet, we take the liberty to use their statements 
as inner regions also for this case. The involved joint PDs should now also verify condition Var [X] < P. The 
corresponding regions will be denoted with an additional i.e., TZ^^^, T^om ^i^^ Ti-^y^. 

Notice that due to the Gaussian additive noises, and depending on the relative values of Pb, Pe (resp. Py, Pz), 
one side information (resp. one channel) is a stochastically degraded version of the other There exist four different 
cases and, from known results (see Section Hl-Bb . separation holds for three of them, as summarized in Table II For 
instance, the case when Bob has "better" channel (Py < Pz) and "worse" side information (Pb > Pe) than Eve 
is still open. We next propose a hybrid digital/analog scheme based on Theorem [3] that turns to be optimal when 
Py < Pz and Pb — > oo. 

B. Hybrid Coding 

In this section, we consider hybrid coding with RVs U, V and X of Theorem [3] defined as J7 = and 

V = aA + -fN , (5) 
X = /P(/3A - jN) , (6) 

where 7 = ^/T^^, and N - 7V(0, 1) is a standard Gaussian random variable independent of A. Note that 
X ^ A/^(0, P) writes as a deterministic function of A and V: 

X = v^{{a + P)A-V) . 

A is defined as the MMSE estimator of A from {V,Y). 

The hybrid digital/analog scheme of Section |III] with the above variables reduces to the one depicted in Fig. [3] 

C. Special Case: Py < Pz, Pb 00 

From now on, we focus on the unsolved case (represented by "?" in Table where Py < Pz- Then, if Bob 
does not have any side information B = % (or equivalently Pb — > 00): 

• The hybrid digital/analog scheme of Section IIV-BI is optimal and yields Theorem ID 

• The digital scheme of lID is strictly sub-optimal, as shown by Proposition [T| and Fig. HI 
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Figure 3: Hybrid digital/analog scheme for secure transmission of a Gaussian source over a Gaussian wiretap 
channel. 



Theorem 4 (Gaussian sources): If Py < Pz and B ~ id, a tuple {D.De) G 

1 



is achievable if and only if 



D > 



1 + ^ 



1 



max <! 1 ; • - 



1 

Pe 



Proof: The converse proof relies on the (conditional) entropy power inequality and is omitted here. The 
direct part follows after Theorem [3] by choosing in the hybrid scheme of Section IIV-BI for any distortion level 

D e 



P + T 



P 

Py 



P 
Pz 



1 + 7^^ 




D I 



P 
P^ 



The next proposition provides a simple expression of region Tl^^^ i.e., the set of all tuples achievable by digital 



scheme E. 

Proposition 1: If Py < Pz and B = 9, {D, A) G T^^g if and only if, for some ^ G 

1 



-;i 



and De = 



D > 



1 + ^ 



De<- 



1 

Pe 



■ min < 1 



D{1 + ^ 



Pz 



Remark 1: If D > 



'f-, then /i = 1 is optimal in Proposition [T] yielding inequalities of Theorem |4] This 
implies that the digital scheme of ID is optimal in this region. For such distortion levels, the quantity De ~ , , i 

+ Pe 

= Var [A\E] is achievable, meaning that Eve cannot retrieve additional information from the communication between 
Alice and Bob. 
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Figure 4: Quantity Z?^; as a function of the distortion level at Bob D {P ~ 1, Py — 0.5, Pz — I, Pe — 1). 

Numerical Results: Fig. |4] represents the largest achievable De as a function of the distortion level at Bob D for 

(i) the optimal hybrid digital/analog scheme of Th. |4] 

(ii) the digital scheme of Prop. [T] (optimizing over /i), 

(iii) a pure analog scheme consisting of directly sending a scaled version of the source over the channel, 

for parameter values P = 1, Py — 0.5, Pz = 1, Pe = 1- 

As a matter of fact, the proposed hybrid digital/analog scheme outperforms both pure analog and digital schemes. 

Remark 2: While the analog scheme is optimal for D ~ ^p, and, from Remark [T] the digital one is optimal 

1+ — 

for D > T— "T?-, a time-sharing combination of these falls short to achieve the entire region, as shown by Fig. |4] 
and Theorem |4] 

V. Secure Transmission of a Binary Source over a Type-II Wiretap Channel 
A. System Model 

Consider now the binary example first proposed in [9|. In this setup, the source is binary uniformly distributed 
(A ^ (i)) and the side information at Bob, resp. Eve, is the output of a binary erasure channel (BEC) with 
erasure probability f3 e [0, 1], resp. a binary symmetric channel (BSC) with crossover probability e e [0, |], with 
input A. According to the values of (/3, e) these side informations satisfy the properties summarized in Fig. |5] The 
communication channel is similar to the one of 111 : It consists of a noiseless channel from Alice to Bob, and a BSC 
with crossover probability C g [0, i], from Alice to Eve. Let the distortion level at Bob be zero i.e., he performs 
lossless reconstruction. 

2e 4e(l-e) /12(e) 

A^B^E B^aE I(A;B) > I{A-E) 

Figure 5: Relative properties of the side informations. 
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Figure 6: Equivocation rate at Eve A as a function of the erasure probability /3 (e = 0.1, ( = 0.1). 

B. Performance of Coding Schemes 

Under the above assumptions, from ||9] Proposition 3], the inner bound of Theorem[T]is maximized by choosing 
V — A and a uniformly distributed binary auxiliary RV U (resp. Q), produced as the output of a BSC with crossover 
probability u e [0, 5] (resp. q e [0, ^]), and input A (resp. X). Consider also the hybrid scheme of Theorem [3] 
choosing variables U, V and X as follows: U = V (B W, V ^ 'S(^) and X — V (B A where W is independent 
of A and V, and W ^ B{u) for some crossover probability u e [0, ^J. 

Numerical Results: Fig. |6] represents the equivocation rate A as a function of the erasure probability /3 for 

(i) the outer bound i.e.. Theorem |2l 

(ii) the hybrid digital/analog scheme of Theorem [3] with U, V, X as defined above (and optimizing over u), 

(iii) the digital scheme of fg] Proposition 3], optimizing over u and q, 

(iv) a pure analog scheme consisting of directly sending the source over the channel, 
for parameter values e ~ 0.1, C — 0.1. 

As expected, if /? < 4e(l — e), B is less noisy than E, and the digital scheme is optimal, as well as the proposed 
hybrid one. Here, this result also seems to hold when B is only more capable than E i.e., for (3 < /12(e)- 

For /3 ~ 1, as noted in |9|, the naive pure analog scheme outperforms the digital one. According to the comments 
of Section Ull-C 11 the proposed hybrid digital/analog scheme always performs as good as the analog one. In Fig. |6] 
the proposed hybrid digital/analog scheme also seems to perform as good as the digital one. However, according 
to the comments of Section IIII-C2I and depending on the parameters e, this may not be the case for all values 
in [/12(e), 1). 
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